Method and apparatus for detecting and differentiating users of a device

ABSTRACT

An apparatus for operator control of an in-vehicle system includes an interface device for receiving inputs for control of the in-vehicle system from an operator hand, the interface device including a control panel having a visual display screen. The apparatus further includes a sensing system adjacent the interface device including an optical proximity sensor having a single infrared light source, a first plurality of directionally sensitive light receivers for detecting a first reflected infrared light from the infrared light source that is reflected by the operator hand only when the operator hand approaches the optical proximity sensor near the interface device from a driver side of the vehicle and a second plurality of directionally sensitive light receivers for detecting a second reflected infrared light from the infrared light source that is reflected by the operator hand only when the operator hand approaches the optical proximity sensor near the interface device from a passenger side of the vehicle. A controller generates a user-specific menu on the visual display screen based upon the first and second plurality of directionally sensitive light receivers detecting respective first and second reflected infrared light from the infrared light source.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a divisional application of U.S. application Ser.No. 11/768,986, filed on Jun. 27, 2007, which claims priority from U.S.Provisional Application No. 60/806,318, filed on Jun. 30, 2006, whichare incorporated herein by reference.

TECHNICAL FIELD

This invention pertains generally to motor vehicles, and methods relatedto interactions between occupants and the vehicle.

BACKGROUND

Vehicle manufacturers and others develop and implement subsystems havingcontrol panels accessible by one or more persons in the vehicle tocontrol various features of the subsystems. Examples of subsystemsinclude on-board navigation systems, wireless communication services,infotainment centers, and climate/HVAC controls. Wireless communicationservices for mobile vehicles, such as navigation and roadsideassistance, have increased rapidly in recent years. Most of the servicesthat have been offered are for a mobile vehicle in operation, wherein anoccupant of the vehicle seeks to utilize the communication service.

Access to specific features of on-vehicle wireless communicationdevices, e.g., navigation and other complex infotainment/telematicsfeatures, may be disabled during specific vehicle operations because ofpotential for vehicle driver distraction. These features are disabledfor the driver and, consequently, are also disabled for a passenger.Alternatively, or in addition, some features have redundant controls forseparate interactions by the driver or any passengers. Disabling accessto specific features and providing redundant controls reduces theusefulness, utilization, and therefore the attractiveness of suchdevices in a vehicle. Climate/HVAC controls can include multiple climatecontrol panels to permit localized control of temperature to eachoccupant. Adding additional control panels in the vehicle increases costand complexity in the vehicle, including costs for the control devicesand wiring harnesses, reducing availability of the feature. Thereforethere is a need for an in-vehicle control panel system which addressesthe aforementioned issues.

SUMMARY

An apparatus for operator control of an in-vehicle system includes aninterface device for receiving inputs for control of the in-vehiclesystem from an operator hand, the interface device including a controlpanel having a visual display screen. The apparatus further includes asensing system adjacent the interface device including an opticalproximity sensor having a single infrared light source, a firstplurality of directionally sensitive light receivers for detecting afirst reflected infrared light from the infrared light source that isreflected by the operator hand only when the operator hand approachesthe optical proximity sensor near the interface device from a driverside of the vehicle and a second plurality of directionally sensitivelight receivers for detecting a second reflected infrared light from theinfrared light source that is reflected by the operator hand only whenthe operator hand approaches the optical proximity sensor near theinterface device from a passenger side of the vehicle. A controllergenerates a user-specific menu on the visual display screen based uponthe first and second plurality of directionally sensitive lightreceivers detecting respective first and second reflected infrared lightfrom the infrared light source.

BRIEF DESCRIPTION OF THE DRAWINGS

Referring now to the figures, which are exemplary embodiments andwherein the like elements are numbered alike:

FIG. 1 is a schematic diagram of a system, in accordance with anembodiment the present invention;

FIG. 2 is a schematic diagram of an element of the system, in accordancewith an embodiment the present invention; and,

FIGS. 3 and 4 are schematic diagrams of embodiments of the system, inaccordance with an embodiment the present invention.

DETAILED DESCRIPTION

Referring now to the drawings, wherein the depictions are for thepurpose of illustrating embodiments of the invention only and not forthe purpose of limiting the same, FIG. 1 is a schematic depiction of apassenger compartment of a vehicle 10 and system that has beenconstructed in accordance with an embodiment of the present invention.The system in this disclosure provides selective controllability of anin-vehicle system, based upon a location of an operator seeking tocontrol the system. There is an interface device 20 which is operable toreceive control inputs from an operator, i.e., individuals in two ormore distinct locations. The locations can be, e.g., in front seats of amotor vehicle, or in a cockpit. There is a location sensing system 40operative to determine the distinct location of the operator providingthe inputs to the interface device 20, e.g., one of a driver and apassenger when the invention is applied to a motor vehicle. There is acontroller 60 (depicted with reference to FIGS. 3 and 4), operative toreceive input signals from the location sensing system 40 and adaptcontrol of the in- vehicle system based upon the distinct location ofthe operator providing the input. The interface device 20 is preferablyoperative to provide visual feedback to the operator, includingidentifying the specific interface device receiving a control input, andthe specific setting for the interface device by which the in-vehiclesystem is controlled. There is preferably an audio-speaker system 90controlled by the controller 60 and operative to provide audio feedbackto the operator, including identify the specific element of theinterface device receiving the control input, and the specific settingfor the element of the interface device by which the in-vehicle systemis controlled. This is now described in detail.

The operator is the person seeking to provide control input to theinterface device 20 to control the in-vehicle system. The operator maybe one of the driver of the vehicle and the passenger placed in thefront seat of the vehicle in the embodiments described herein. Theinterface device 20 which receives control inputs from either of theoperators includes a control panel comprising a plurality of elements.The elements comprise a visual display screen 26 that may betouch-activated, buttons 24, switches, and knobs 22 that are operatorselectable or operator-adjustable. The interface device 20 is preferablylocated in a console between the driver and passenger in the frontseating area of the vehicle. The elements of the control panel sendsignals for controlling various features of the in-vehicle system,either directly or via controller 60. The interface device including thecontrol panel is preferably readily viewable and accessible by both thedriver and the passenger. The in-vehicle system being controlled mayinclude such non-limiting examples as an on-board navigation system, aclimate control/HVAC system, an entertainment and information system,and, a wireless communications system.

Referring now to FIG. 2, there is depicted an embodiment of the locationsensing system 40. The location sensing system 40 is placed adjacent tothe interface device 20 and is signally connected to the controller 60.The location sensing system 40 is operative to identify a location ofthe operator, and identify the person seeking access to and thus provideinput to the control panel of the interface device 20 as one of thevehicle driver and the passenger. The location sensing system 40preferably comprises an optical proximity sensor comprising an opticalsensing device having short-range directional sensing capability. In theembodiment depicted, the optical proximity sensor consists of a singleshort-range infrared (‘IR’) LED device 42 which emits a low powerinfrared light beam during operation of the vehicle. There are lightreceivers 44, 46 which comprise known devices operative to sense IRlight reflected from the LED device 42. As depicted, there are two lightreceivers 44 on the right side of the LED device 42 adapted to detect IRlight reflected from a hand or finger of the passenger, and exclude IRlight reflected from a hand of the driver. There are two light receivers46 on the left side of the LED device 42 adapted to detect IR lightreflected from a hand or finger of the driver, and exclude IR lightreflected from a hand of the passenger. Thus, the light emitted from theinfrared light source detected by the light receivers 44 on the rightside of the LED device 42 is mutually exclusive from the light emittedfrom the infrared light source detected by the light receivers 46 on theleft side of the LED device 42. Excluding IR light reflected from eitherthe driver or the passenger is preferably accomplished by selectiveplacement, physical orientation, and shielding of the specific lightreceivers 44, 46. Under normal operation, when neither the driver northe passenger seeks to control features of the in-vehicle system, thereis minimal reflected light to receivers 44 and 46, and the output of thelocation sensing system 40 is neutral. When the driver seeks to controlfeatures of the in-vehicle system by placing a hand near the interfacedevice 20, the output of the location sensing system 40 so indicates,via signals from receivers 46 transmitted to the controller 60.Similarly, when the passenger seeks to control features of thein-vehicle system by placing a hand near the interface device 20, theoutput of the location sensing system 40 so indicates via signals fromreceivers 44 transmitted to the controller 60. The output of thelocation sensing system is continually and ongoing communicated to thecontroller 60. The location sensing system 40 is depicted as a devicewith sensors and LED laid out in a single horizontal line, but the lightreceivers 44, 46 can be placed in various configurations for effectivedetection of the operator, including a vertical configuration, or aconical configuration, to prevent a misperception of an operator.Alternatively, the location sensing system 40 comprises a single LEDdevice 42 and one or more receivers 44, and is positioned to detect onlythe passenger. Alternatively, the location sensing system 40 comprises asingle LED device 42 and one or more receivers 46 and is positioned todetect only the driver. Alternatively, the sensor may comprise a thermalsensing device, or other sensing technologies suitable for identifyinglocation of the operator that operates as disclosed herein.

In a first embodiment, the in-vehicle system comprises an on-boardnavigation system. For safety reasons, the controller 60 acts to preventthe driver from interfacing with the navigation system when the vehicleis operating, i.e., in gear. However, the interface device 20 isconstantly active and accessible to the passenger. When the locationsensing system 40 determines that the driver is attempting to access theinterface device 20, it communicates the information to the controller60, which locks the interface device 20, preventing input from thedriver until such operating conditions occurring for the controller 60to permit access by the driver, e.g., when the vehicle transmission isin ‘park’.

In a second embodiment, the in-vehicle system comprises the on- boardnavigation system. The interface device 20 is constantly locked andinaccessible to the driver. When the location sensing system 40determines that the passenger is attempting to access the interfacedevice 20, it communicates the information to the controller 60, whichunlocks the interface device 20, permitting access and input from thepassenger.

In a third embodiment, the in-vehicle system comprises a climatecontrol/HVAC system operative to provide climate control in the vehiclepassenger compartment that is location-specific. Such systems consist ofproviding individual temperature control and fan speed control to thedriver and the passenger. The interface device 20 is preferablyconstantly active and accessible to the passenger and the driver duringvehicle operation. The location sensing system 40 determines which ofthe driver and the passenger is accessing the interface device 20, andcommunicates the appropriate information to the controller 60. Thecontroller monitors inputs to the interface device 20, and adjusts thecontrols to the climate control/HVAC system based upon whether theoperator input is from the driver or the passenger. The climatecontrol/HVAC system is controlled by a single interface device,preferably consisting of a single set of operator-adjustable knobsadapted to control temperature and blower fan settings. The singleinterface device is operative to effect control of the climatecontrol/HVAC system specific to the driver, specific to the passenger,and, vehicle-wide.

Thus, the passenger can use the single interface device to controlclimate in their zone of the passenger compartment, and the driver canuse the single interface device to control climate in their zone of thepassenger compartment, and both the driver and the passenger can use thesingle interface device to control climate in the entire passengercompartment, if so desired. Alternate access and lockout functionalitymay be implement also. By way of example, it may be desirable that thedriver be provided full authority over the system being controlledwhereas the passenger is provided limited authority. In the exemplaryclimate control/HVAC system, this may be implemented by provided thepassenger with climate control/HVAC authority for the passenger's zoneonly without any authority over the driver's zone settings or thevehicle wide settings. The driver, on the other hand, may be providedcomplete authority over driver zone, passenger zone and vehicle widesettings. The controller may be adapted to transmit an audio signal tothe passenger compartment of the vehicle indicating the specific controlfeature being adjusted (e.g., “temperature”, or “fan setting”), and thesetting of the control feature (e.g., “21° C.”, or “medium-low”).

In a fourth embodiment, the in-vehicle system consists of one of anavigation system, a climate control system, an entertainment system,and a wireless communications system. As depicted with reference to FIG.3, the system comprises an entertainment system. The location sensingsystem 40 functions as the proximity sensor previously described, toidentify the location of the operator, i.e., the passenger or thedriver. Furthermore, the location sensing system 40 is adapted toprovide a portion of the interface functions. In this embodiment, theinterface device 20 is preferably a visual touch-activated screen, oralternatively, the visual screen and a plurality of operator-adjustableknobs and buttons. The location sensing system 140 comprises a pair ofoptical proximity sensors 141. The optical proximity sensors 141 areeach placed in a substantially vertical orientation and substantiallyparallel to each other, although the orientation of the sensors ispertinent only in relationship to the ability of the sensors to discernand differentiate between the driver and the passenger, to permit readyaccess by the respective one of the driver and the passenger, and toprevent interaction therebetween. Thus, the optical proximity sensors141 may be placed substantially parallel to a longitudinal axis of thevehicle, with the orientation of each sensor tilting away from eachother and away from a z-axis (i.e. vertical) orientation of the vehicle.Each of the optical proximity sensors 141 consists of a singleshort-range infrared (‘IR’) LED device 142 which emits infrared lightduring operation of the vehicle. There is a plurality of light receivers(144-passenger, 146-driver) which comprise known devices operative tosense reflected IR light from the LED device 142. The individual lightreceivers 144(a)-144(d) and 146(a)-146(d) are preferably alignedlinearly. The individual light receivers 144(a)-144(d) and 146(a)-146(d)are signally individually connected to the controller such that thecontroller is able to discern therebetween. Thus the controller caninterpret an input comprising IR light reflected to any one of, or aplurality of the individual light receivers. In operation, when anoperator seeks to adjust one of the systems, e.g., the entertainmentsystem depicted with reference to FIG. 3, their hand approaches thelocation sensing system 140, thus activating operation of the system.The controller 60 determines the operator to be either the passenger orthe driver, and generates a user-specific menu on the touch-activatedscreen of the interface device 20. The operator moves their hand or afinger along the optical proximity sensor 141, sending signals from theindividual light receivers which are read and interpreted by thecontroller 60, which acts to scroll along the user-specific menu on thetouch-activated screen of the interface device 20. The operator usestheir finger along the proximity sensor to select from the menu, as readby the controller. The controller then activates the selected system.There may be additional inputs to control the operation of the selectedsystem via the touch-activated screen of the interface device 20. In thesystem depicted in FIG. 3, the menu includes various radio frequenciesor bands (AM, FM, XM) and other devices or sources (CD, HDD, AUX, andSOUND). The individual preferences for the passenger and the driver arepreferably preset using conventional mechanisms.

Referring now to FIG. 4, a fifth embodiment is depicted, comprising amulti-function system, including interface device 20′. In thisembodiment, the location sensing device 140 is as previously depictedwith reference to FIG. 3. The interface device 20′ provides access tomultiple in-vehicle systems, depicted as climate control, audio control,and navigation. The operator is able to select one of the systems usingthe location sensing device 140, typically by holding their finger in afixed location for a predetermined period of time, e.g., two seconds.Again, the controller 60 is able to detect whether the operator is thedriver or the passenger, and prevent the driver from having access tothe navigation system unless specific operating conditions are met. Oncea specific system has been selected, depicted herein as climate control,a second menu appears on the interface device screen, comprising aseries of functions specific to the system. The operator can select oneof the functions, and adjust the setting. The in-vehicle system iscontrolled in conjunction with conventional inputs (knobs) of theinterfaces, or stand-alone. The interface device 20′ which receivescontrol inputs from the operators is a control panel consisting of othercontrol devices, e.g., a plurality of buttons, switches, and knobs. Theinterface device 20′ is preferably located in a console between thedriver and passenger in the front seat of the vehicle. The controldevices of the control panel are operative to control various featuresof the in-vehicle system. The interface device including the controlpanel is preferably readily viewable and accessible by both the driverand the passenger.

The system described herein uses an optical-based sensing system toidentify and locate operators of the system and provide system accessthat is differentiated based upon the location of the operator. When thevehicle is operational, and a person seeks to interact with the controlpanel, output from the sensor is fed into a control algorithm which ispreferably resident in the control panel. When the sensor discerns theperson seeking to interact with the control is on the left-side of thevehicle, indicating the vehicle operator, the control algorithmcontinues to limit access, thus permitting the operator access only tothose features allowable during vehicle operation. When the sensordiscerns the person seeking to interact with the control is on theright-side of the vehicle, indicating the passenger, the controlalgorithm selectively activates the control panel, thus permitting thepassenger access to most or all features on the control panel duringvehicle operation. When the sensor discerns that both the operator andthe passenger are seeking access to the control panel, the controlalgorithm can act to limit access, thus continuing to limit the operatoraccess only to those features allowable during vehicle operation. Whenthe passenger discontinues the interaction by removing their hand,discernible by the sensor, the control algorithm selectively deactivatesthe control panel to its original state, again permitting the operatoraccess only to those features allowable during vehicle operation.

It is understood that modifications are allowable without departing fromthe scope of the disclosure. It is further understood that applicationsof the system reach beyond the automobile, to any vehicles, such asaviation applications, wherein there is a pilot and a co-pilot. Thedisclosure describes certain embodiments and modifications thereto.Further modifications and alterations may occur to others upon readingand understanding the disclosure. The disclosure is intended to includeall such modifications and alterations insofar as they come within thescope of the appended claims.

1. Apparatus for operator control of an in-vehicle system, comprising:an interface device for receiving inputs for control of the in-vehiclesystem from an operator hand, said interface device comprising a controlpanel including a visual display screen; a sensing system adjacent theinterface device comprising an optical proximity sensor including asingle infrared light source, a first plurality of directionallysensitive light receivers for detecting a first reflected infrared lightfrom the infrared light source that is reflected by the operator handonly when the operator hand approaches the optical proximity sensor nearthe interface device from a driver side of the vehicle and a secondplurality of directionally sensitive light receivers for detecting asecond reflected infrared light from the infrared light source that isreflected by the operator hand only when the operator hand approachesthe optical proximity sensor near the interface device from a passengerside of the vehicle; and a controller generating a user-specific menu onthe visual display screen based upon the first and second plurality ofdirectionally sensitive light receivers detecting respective first andsecond reflected infrared light from the infrared light source.
 2. Theapparatus of claim 1, wherein the in-vehicle system comprises anavigation system, and the controller is operative to disable control ofthe navigation system when the first plurality of directionallysensitive light receivers detects the first reflected infrared light. 3.The apparatus of claim 1, wherein the in-vehicle system comprises anavigation system, and the controller is operative to enable control ofthe navigation system when the second plurality of directionallysensitive light receivers detects the second reflected infrared light.4. The apparatus of claim 1, wherein: the in-vehicle system comprises alocation-specific climate control system; the interface device forreceiving inputs for control of the climate control system from theoperator hand consists of a single interface device; and the controlleris operative to provide location-specific climate control for theoperator to one of the passenger side of the vehicle and the driver sideof the vehicle based upon the one of the first and second plurality ofdirectionally sensitive light receivers detecting respective first andsecond reflected infrared light from the light source.
 5. The apparatusof claim 1, wherein: the in-vehicle system comprises an entertainmentsystem; the interface device for receiving inputs for control of theentertainment system from the operator hand consists of a singleinterface device; and the controller is operative to provideoperator-specific entertainment control based upon the one of the firstand second plurality of directionally sensitive light receiversdetecting respective first and second reflected infrared light from thelight source.
 6. The apparatus of claim 1, further comprising anaudio-speaker system controlled by the controller operative to provideaudio feedback to the operator comprising the specific interface devicereceiving the control input and the specific setting for the interfacedevice.